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REMARKS 

Enclosed herewith is a Substitute Specification in which 
the changes instituted by the Preliminary Amendment filed with this 
application have been incorporated. In addition, the specification 
as filed has been further amended to correct typographical and 
grammatical errors, and also to number the paragraphs. 

In addition to the above, the Substitute Specification now 
cites U.S. Patent 5,933,798 (see paragraph [0004] on page 2), which 
issued from U.S. Patent Application Serial No. 08/895,250, filed 
July 16, 1997, which was cited in the Preliminary Amendment as 
corresponding to International Patent Application WO 98/03014 cited 
in the specification as filed. Enclosed herewith is form PTO-1449 
citing this U.S. patent, as well a copy of the patent. 

In support of the above, enclosed herewith is a copy of 
the specification as filed marked up with the above changes. 

The undersigned attorney asserts that no new matter has 
been incorporated into the Substitute Specification. 

The Examiner has rejected claims 1-6 under 35 U.S.C. 
102(e) as being anticipated by U.S. Patent 6,278,792 to Cox et al . 

The Cox et al. patent discloses a robust digital 
watermarking in which a watermark to be embedded in a picture is a 
vector W[k], k=l...N. The watermark is embedded in the DCT domain. To 
this end, an equally long vector V[k] is extracted from the 
picture. More particularly, the DCT coefficients of the picture are 
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classified into N sets. A weighted sum of the coefficients of set 1 
constitutes V[l], a weighted sum of the coefficients of set 2 
constitutes V[2], etc. The picture is modified such that its vector 
V[k], k=l...N, has a high correlation with W[k] . 

The watermark detection is shown in Fig. 8. The detector 
receives an MPEG stream. The stream is Huffman decoded (80) so that 
the DCT coefficients are available. The coefficients are classified 
as described above and summed in an accumulator (82) to obtain a 
vector having length N. This vector is then correlated (84) with 
the watermark W[k] to be detected. 

Fig. 10 of Cox et al. relates to detection of a watermark 
in a picture that has been subjected to an unknown offset in the 
horizontal and/or vertical direction. To this end, a specific 
registration pattern is embedded in the picture. The watermark 
detection process, which is shown in Fig. 10, comprises four 
distinctive phases: 

1. Detection of the registration pattern (102, 104, 106); 

2. Compensation of the offset based on the registration pattern 
(108) ; 

3. Back-transforming the picture to the DCT domain (110, 112); and 

4. Watermark detection in the DCT domain (114, 116, 118). 

Applicants submit that based on the above analysis, the 
Examiner is incorrect in stating that the processes 106-118 meet 
the claimed watermark detection step. While the processes 106-118 
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include watermark detection, the processes 106-118 do not 
constitute watermark detection . More particularly, Cox et al. 
discloses the watermark detection to be carried out in the DCT 
domain, while in the claimed invention, the watermark detection is 
performed in the spatial domain, i.e., after inverse transforming 
the DCT coefficients. 

Applicants submit that there are two essential differences 
between the watermark detector of Cox et al . and the subject 
invention: 

a. The DCT coefficients that Cox et al. accumulates (82) are 
associated with one picture, while the subject invention 
accumulates spatially corresponding coefficients of a plurality of 
pictures; and 

b. Cox et al. detects the watermark in the DCT domain, while the 
subject invention does so in the spatial domain. 

In view of the above, Applicants believe that the subject 
invention, as claimed, is neither anticipated nor rendered obvious 
by the prior art, and as such, is patentable thereover. 



S : \G0\PY1 1GOA0 . GOR 



7 



Applicants believe that this application, containing 
claims 1-6, is now in condition for allowance and such action is 
respectfully requested. 

Respectfully submitted, 




Edward W. Goodman, Reg. 28,613 
Attorney 

Tel.: 914-333-9611 

CERTIFICATE OF MAILING 

It is hereby certified that this correspondence is being 
deposited with the United States Postal Service as First-class mail 
in an envelope addressed to: 

COMMISSIONER OF PATENTS AND TRADEMARKS 
Washington, D.C. 20231 
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SUBSTITUTE SPECIFICATION 

DETECTION OF A WATERMARK IN A COMPRESSED VIDEO SIGNAL 

FIELD BACKGROUND OF THE INVENTION 

Field Of The Invention 

[0001] The invention relates to a method and arrangement 

for detecting a watermark in a compressed video signal . The 
invention also relates to an arrangement for decoding a compressed 
video signal so as to obtain a signal which ia suitable for 
watermark detection. 

BACKGROUND OF THE INVENTION Description Of The Related Art 

[0002] Watermarking is a technique of embedding 

imperceptible information in multimedia contents such as contents, 
such as. audio, still images or moving video. Watermarks are used 
for applications ouch as applications , such as, ownership 
verification, copyright protection and copy and playback control . 

[0003] A watermark is often embedded in a video signal 

by slightly modifying the luminance pixels of the video signal in 
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accordance with a watermark pattern. For the purpose of 
understanding this invention, it suffices to imagine the watermark 
pattern as an array of +1 and — ^--1 values which io added to an 
equally sized array of pixels. The array of pixels having the same 
5 size as the watermark pattern is hereinafter referred to as a 
"picture" . "picture" . A picture may be a full-size video image 
(480*720 pixels for NTSC or 576*720 pixels for PAL) or a part 
thereof, for example, a sub-image of 128*128 pixels. If the 
watermark pattern is smaller than the image, it is known as a 
10 "tile" . "tile" . The pattern is then repeatedly used to obtain a 

"tiled" " tiled" image. It is assumed that a plurality of pictures is 
watermarked with the same watermark pattern. 

[0004] Detection of a watermark in a picture is, in 

essence, a thresholded correlation operation. A watermark detector 

15 decides whether or not a suspect picture is watermarked by 

computing the amount of correlation between the suspect picture and 
the watermark pattern to be detected, and comparing the result with 
a predetermined threshold. An example of such a watermark detector 
is disclosed in Applicant ' o Applicant ' s International Patent 

20 Application WO A 08/03014 . W O-A-98/03014 , corresponding to U.S. 
Patent 5,933,798. 

^Ph e [0005] The subject invention addresses the 

problem of detecting a watermark in a compressed video signal. 
Video compression reduces the amount of data to be transmitted or 
2 5 recorded. A well-known example is MPEG compression. Briefly 
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summarized, MPEG compression includes discrete cosine transform 
(DCT) of blocks of pixel values into blocks of coefficients. The 
coefficients are quantised, — which causca guantized causing many 
coefficients to assume the value zero. The quantized coefficients 
5 are variable lengthen codcd variable- length encoded by assigning a 
Huffman codeword to each run of zero coefficients and a subsequent 
non-zero coefficient. The pictures can be encoded autonomously ( I- 
-f^pictures) , or predictively -fP — and B pictures) . (P- and IB- 
pictures ) . In the latter case, residual pixel blocks (which are 

10 left after subtracting motion-compensated prediction blocks) are 
transformed rather than the pixel blocks themselves. 

[0006] A straightforward method of detecting the 

watermark employs a cascade arrangement of a conventional MPEG 
decoder and a conventional watermark detector. However, it has a 

15 total complexity which is too large to serve as a viable solution 
for mere watermark detection^ because MPEG decoding is a costly 
operation in terms of numbers of operations, complexity and amount 
of memory. This is particularly true for a DVD drive which is 
envisaged to include a watermark detector so as to determine 

20 whether a video program may be copied or not, or may not be copied, 
but does not itself include an MPEG decoder. 

OBJECT AND SUMMARY SUMMARY OF THE INVENTION 
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[0007] It is an object of the invention to provide a 

cost-effective method of detecting a watermark in a compressed 
video signal . 

[0008] To this end, the method in accordance with the invention comprises the steps 

5 of accumulating spatially corresponding coefficients of a plurality of pictures, inverse transforming 
said accumulated coefficients into an accumulated plurality of pictures, m4 

and detecting the watermark in said accumulated plurality of 
pictures . 

[00091 The invention is based on the recognition that a 

10 watermark embedded in a plurality of pictures is more reliably 

detected if said the plurality of pictures is first accumulated and 
the watermark detection is then carried out on the result of 
oaid the accumulation. The invention further exploits the insight 
that (inverse) transformation and accumulation are commutative 

15 operations which may be carried out in a reversed order. 

[00101 The method has significant advantages over the 

straightforward method of first conventionally decoding the video 
signal and then detecting the watermark in the decoded signal. The 
number of inverse transform operations per unit of time is 

20 considerably reduced. Instead of inverse transforming each 

individual block of coefficients, the inverse transform is not 
carried out until a plurality of pictures has been accumulated, 
i.e.^ once per watermark detection period. Another advantage of the 
invention follows from the consideration that the coefficients of 

25 an MPEG cncodcd M PEG- encoded video signal are variable-length 
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encoded and that the number of bits per picture largely depends on 
whether the picture is an 3 — ; — P — or B picture. I- , P- or B-picture. 
In view thereof, a conventional MPEG decoder includes a large input 
buffer for converting the nearly constant bit^rate of the MPEG 
5 bitstream (for DVDj_ of the order of 10 Mbit/s) into a heavily 
varying bit^rate with maxima up to 40 Mbit/s, and the variable- 
length decoder must be capable of processing the highest 
instantaneous bit^rate. By interchanging the order of inverse 
transform and accumulation, the variable-length decoding can be 

10 carried out at the input bit^rate. The variable-length decoder is 
considerably simplified and the large input buffer can be 
diapcnscd is not needed, with . — Further, the buffer for accumulating 
the coefficients has the size of the watermark pattern. For 
detecting a watermark in " tiled" "tiled" images, such a buffer is 

15 considerably smaller than the full-size image buffer of a 
conventional MPEG decoder. 

[00111 It has been found that the watermark is 

sufficiently present in residual pixel blocks. In view thereof, it 
is not necessary to reconstruct P — and B pictures . P- and B- 

2 0 pictures . The coefficients of these pictures may be accumulated 

directly. It has also been founds and experimentally verified^, that 
motion compensation can be omitted for the purpose of watermark 
detection. The accumulation of coefficients may be carried out 
irrespective of motion vectors included in the signal. Circuitry 

2 5 for reconstructing P and B picturco such as P- and B-pictures, such 
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as , a variable-length decoder for decoding motion vectors, a motion 
compensator, and two full size frame momorica can thug f ull-size 
frame memories, are bo dispensed with . therefore not needed. 

5 BRIEF DESCRIPTION OF THE DRAWING 

Fig . — 1 ahowg schematically [0012] Fig . 1 

shows , schematically, an arrangement for detecting a watermark in 
accordance with the invention . invention; 

Fig . — £[0013] Fig . 2 shows a diagram to illustrate 

10 the operation of the arrangement which is shown in Fig. — jr^ Fig. 1; 
and 

Fig. — £[0014] Fig. 3 shows a DVD drive including 

the arrangement which is shown in Fig. — j-^- shown in Fig. 1. 

15 DESCRIPTION OF AN EMDOD IMENT DE S C R I PT I ON OF THE PREFERRED 

EMBODIMENTS 

Fig. 1 shows sch e matically fOOlSI Fig. 1 shows, schematically, an 

arrangement for detecting a watermark in accordance with the invention. The arrangement comprises 
a variable-length decoder 1, an accumulator 2, a buffer 3, an address generator 4, an inverse discrete 
2 0 cosine transformer 5 and a watermark detection circuit 6. The watermark detection circuit 6 is a 
conventional watermark detector as disclosed, for example, in int e rnational pat e nt application 
WO A 9 8 /03014. 

International Patent Application WO-A-98/03014 ; 

[0016] The arrangement receives a compressed video 

25 signal in the form of an MPEG bitstream MP. The majority of the 
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payload of the MPEG bitstream includes variable lengthen 
coded variable- length encoded coefficients and motion vectors. In 
accordance with an aspect of the invention, the motion vectors are 
ignored. The codewords representing coefficients are decoded by the 
5 variable-length decoder 1. Many coefficients have the value zero. A 
single codeword represents a run of zero coefficients and a 
subsequent non-zero coefficient. A special codeword denotes the end 
of a block. For each coefficient, the variable-length decoder 1 
generates the coefficient value C and its ordinal number n, i.e.j_ 

10 its relative position in the block of 8*8 coefficients. 

[0017] The spatially corresponding coefficients of a 

plurality of pictures are accumulated in an accumulation buffer 3. 
It is here assumed that the picture size (and thus the buffer size) 
is 128*128 pixels, i.e.j_ an integral number of DCT blocks. The 

15 buffer 3 is addressed by an address generator 4 which keeps count 
of the position of the current DCT block within the picture and 
receives the ordinal coefficient number n from the variable- length 
decoder 1. The accumulator 2 adds the current coefficient value C 
to the result accumulated thus far. It is noted that, in accordance 

20 with one aspect of the invention, the coefficients are accumulated 
irrespective of whether they represent pixels or residual pixels, 
i.e.j_ whether they originate from autonomously encoded I pictureo l- 
pictures or predictively encoded P — or B pieturco. P- or B-pictures. 
The above deocribed [00181 The 

25 above -described operational steps are illustrated in Fig . — 2- ^Fia. 2. 
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In this Figure, reference numeral 9 represents a full-size tiled 
image in the transform domain. The image has been watermarked by 
repeatedly adding a watermark pattern to ( sub) pictures 91-99 having 
a size of 128*128 pixels. As shown on the right-hand side of the 
5 Figure, the pictures 91-99 are folded and accumulated so that an 
accumulated picture 100 is obtained (still in the transform 
domain) . 

[00191 After accumulating the coefficients of a 

predetermined number of pictures (e.g.^ all pictures forming a 

10 full-size tiled image and/or a plurality of images) , the 

accumulated result is applied to the DCT circuit 5 in which 1 it is 
inverse transformed into the spatial domain. The accumulated 
spatial "picture" "picture" P is then applied to the conventional 
watermark detection circuit 6. 

15 Fig. 3 [0020] Fig. 3 shows a DVD drive for playing 

back an MPEG bitstream which is recorded on a disc 31. The recorded 
signal is applied to an output terminal 33 via a switch 32. The 
output terminal is connected to an external MPEG decoder and 
display device (not shown) . It is assumed that the DVD drive may 

20 not play back video signals with a predetermined embedded 

watermark— unless other conditions, which are not relevant to the 
invention, are fulfilled. For example, watermarked signals may only 
be played back if the disc 31 includes a given "wobble" "wobble" 
key. In order to detect the watermark, the DVD drive comprises a 

25 watermark detector 34 as described above with reference to 
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Fig . — 3r rFig. 1. The watermark detector 34 receives the recorded 
signal and controls the switch 32 in response to whether or not the 
watermark is detected. 

[0021] In summary, a method and arrangement for 

5 detecting a watermark embedded in an MPEG compressed signal are 
disclosed. A conventional MPEG decoder is stripped to such an 
extent that a modified baseband video signal suitable for watermark 
detection is obtained In accordance with the invention, a plurality 
of pictures with the embedded watermark is accumulated in the 
10 transform domain, and the inverse DCT is applied to the accumulated 
result. Conventional watermark detection is then applied to the 
accumulated plurality of pictures in the spatial domain. 
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CLAIMS: 



h A m e thod of d e t e cting a wat e rmark in a compressed vid e o signal comprising 

sp e ctral co e ffici e nts obtain e d by transforming pictures of said vid e o signal, charact e riz e d in that th e 
m e thod compris e s th e st e ps of: 

accumulating spatially corresponding co e ffici e nts of a plurality of pictur e s; 
5 inverse transforming said accumulat e d co e ffici e nts into an accumulated plurality of pictures; and 

d e t e cting th e wat e rmark in said accumulat e d plurality of pictures. 

2t A method as claimed in claim 1, wh e r e in said e ncoded video signal includes 

pr e dictiv e ly e ncod e d pictur e s e ach comprising coefficients repr e s e nting a r e sidual pictur e aft e r 
10 subtracting a prediction pictur e , th e st e p of accumulating co e fficients being applied to the 

coefficients r e pr e s e nting said r e sidual pictur e s irr e spective of coefficients r e pr e s e nting th e pr e diction 
pictur e . 

I-. A m e thod as claim e d in claim 2, wherein said predictiv e ly e ncod e d pictures 

15 further include motion v e ctors, th e st e p of accumulating co e fficients being carried out irresp e ctiv e of 
said motion v e ctors. 

4z An arrang e m e nt for d e t e cting a watermark in a compr e ss e d vid e o signal 

comprising sp e ctral co e ffici e nts obtain e d by transforming pictures of said video signal, characterized 
20 in that th e arrangem e nt comprises: 

m e ans (2,3,4) for accumulating spatially corresponding coeffici e nts of a plurality of pictures; 
m e ans (5) for inv e rs e transforming said accumulat e d co e ffici e nts into an accumulat e d plurality of 
pictures; and 
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m e ans (6) for d e t e cting th e watermark in said accumulat e d plurality of pictur e s 



&z An arrang e m e nt for d e coding a compr e ss e d vid e o signal comprising sp e ctral 

co e ffici e nts obtain e d by transforming pictures of said vid e o signal, characteriz e d in that th e 
arrang e m e nt compris e s: 

means (2,3, 4 ) for accumulating spatially corresponding coefficients of a plurality of pictur e s; and 
means (5) for inverse transforming said accumulat e d co e ffici e nts into an accumulat e d plurality of 
pictures. 

& — = A d e vic e for r e cording and/or playing back a compressed vid e o signal, comprising 

m e ans (32) for disabling r e cording and/or playback of th e vid e o signal in d e p e nd e nc e upon th e 
presence of a watermark in said vid e o signal, charact e riz e d in that th e d e vic e compris e s an 
arrang e m e nt (36) a s claim e d in claim 4 for detecting said wat e rmark in th e vid e o signal. 
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ABSTRACT: 
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ABSTRACT OF THE DISCLOSURE 



-A method and arrangement for detecting a 



watermark embedded in an MPEG compressed signal arc diocloocd. 
Aincludes a conventional MPEG decoderie stripped to such an extent 
that a modified baseband video signal suitable for watermark 
5 detection is obtained. In accordance with the invention, — aA 

plurality of pictures with the embedded watermark is accumulated 
(2,3,4) in the transform domain, and the inverse DCT (5) is applied 
to the accumulated result. Conventional watermark detection (6) is 
then applied to the accumulated plurality of pictures in the 
10 spatial domain. 
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